﻿2026-06-06T06:11:15.3640847Z ##[group]Run cargo test -p spt-daemon --test twohost -- --nocapture
2026-06-06T06:11:15.3641628Z [36;1mcargo test -p spt-daemon --test twohost -- --nocapture[0m
2026-06-06T06:11:15.3660420Z shell: /usr/bin/bash -e {0}
2026-06-06T06:11:15.3660785Z env:
2026-06-06T06:11:15.3661057Z   SPT_TWO_HOST: 1
2026-06-06T06:11:15.3661363Z   SPT_TWO_HOST_ROLE: b
2026-06-06T06:11:15.3661704Z   SPT_TWO_HOST_SECRET: rig-twohost-ci
2026-06-06T06:11:15.3662106Z   SPT_TWO_HOST_PEER_IP: 100.68.35.65
2026-06-06T06:11:15.3662495Z   SPT_TWO_HOST_WAIT_SECS: 900
2026-06-06T06:11:15.3663257Z   SPT_TWO_HOST_NOTIFY_BIN: /home/david/actions-runner/_work/spt-core/spt-core/.adapter-notify/target/debug/notify-shell
2026-06-06T06:11:15.3664055Z ##[endgroup]
2026-06-06T06:11:15.7906210Z    Compiling fastrand v2.4.1
2026-06-06T06:11:15.8075837Z    Compiling rustix v1.1.4
2026-06-06T06:11:15.9718634Z    Compiling futures-lite v2.6.1
2026-06-06T06:11:15.9719647Z    Compiling backon v1.6.0
2026-06-06T06:11:16.9623975Z    Compiling n0-future v0.3.2
2026-06-06T06:11:17.0361819Z    Compiling n0-watcher v0.6.1
2026-06-06T06:11:17.0362745Z    Compiling iroh-dns v0.98.0
2026-06-06T06:11:17.2490462Z    Compiling netwatch v0.16.0
2026-06-06T06:11:17.4745334Z    Compiling iroh-relay v0.98.0
2026-06-06T06:11:18.4830478Z    Compiling tempfile v3.27.0
2026-06-06T06:11:18.9850560Z    Compiling portmapper v0.16.0
2026-06-06T06:11:22.6328932Z    Compiling iroh v0.98.2
2026-06-06T06:11:34.6882756Z    Compiling spt-net v0.1.0 (/home/david/actions-runner/_work/spt-core/spt-core/crates/spt-net)
2026-06-06T06:11:36.9423900Z    Compiling spt-daemon v0.1.0 (/home/david/actions-runner/_work/spt-core/spt-core/crates/spt-daemon)
2026-06-06T06:11:45.5565499Z     Finished `test` profile [unoptimized] target(s) in 30.12s
2026-06-06T06:11:45.5854706Z      Running tests/twohost.rs (target/debug/deps/twohost-18963cf7f1d6c3f2)
2026-06-06T06:11:45.5891415Z 
2026-06-06T06:11:45.5891850Z running 2 tests
2026-06-06T06:11:45.5894063Z test two_host_ladder_role_a ... ok
2026-06-06T06:11:45.5903281Z TWOHOST role B: node 9bbcee970607c7454b0baf8b38b032ccdf1a36de7ef04d614158fecd1f08b612
2026-06-06T06:11:45.7209392Z TWOHOST role B: notify instance notify-0 minted (real_mode=true)
2026-06-06T06:11:45.7481773Z TWOHOST role B: drive session 1 ready
2026-06-06T06:11:45.9008313Z PAIRED: joiner pinned (Pinned)
2026-06-06T06:11:45.9975358Z TWOHOST OK: pairing: A pinned via the daemon-hosted responder
2026-06-06T06:11:45.9980207Z TWOHOST OK: pairing (responder, daemon-hosted)
2026-06-06T06:11:51.2977599Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:11:56.4175200Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:12:01.5406026Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:12:06.6588555Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:12:12.0590179Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:12:17.1845418Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:12:22.3246623Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:12:27.4632302Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:12:32.6078023Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:12:37.7695123Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:12:42.8928294Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:12:45.5896640Z test two_host_ladder_role_b has been running for over 60 seconds
2026-06-06T06:12:48.0315844Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:12:53.1707993Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:12:58.3079669Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:13:03.4928231Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:13:08.6357852Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:13:13.7549052Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:13:18.8769839Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:13:24.0103194Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:13:29.1347289Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:13:34.2510238Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:13:39.3817991Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:13:44.4933304Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:13:49.6102740Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:13:54.7292804Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:13:59.8794346Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:14:05.0128828Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:14:10.1277576Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:14:15.2804561Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:14:20.4025328Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:14:25.5147002Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:14:30.6476998Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:14:35.7777944Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:14:40.9357826Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:14:46.0621862Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:14:51.1753821Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:14:56.2993249Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:15:01.4274398Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:15:06.5448585Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:15:11.6919470Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:15:16.8184904Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:15:21.9403068Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:15:27.0631815Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:15:32.1911747Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:15:37.3368432Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:15:42.4606014Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:15:47.5643424Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:15:52.6851061Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:15:57.8037252Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:16:02.9214107Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:16:08.0410343Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:16:13.1555218Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:16:18.2829909Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:16:23.4054299Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:16:28.5368915Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:16:33.6915120Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:16:38.7936527Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:16:43.9117208Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:16:49.0250363Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:16:54.1449073Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:16:59.2662058Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:17:04.3808586Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:17:09.5250892Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:17:14.6415163Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:17:19.7621260Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:17:24.8771990Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:17:29.9907833Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:17:35.1085264Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:17:40.2266808Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:17:45.3440644Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:17:50.4533243Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:17:55.5676186Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:18:00.7051726Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:18:05.8479588Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:18:10.9688866Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:18:16.0835713Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:18:21.2277513Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:18:26.3717636Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:18:31.4843729Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:18:36.6066722Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:18:41.7273656Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:18:46.8401686Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:18:51.9753756Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:18:57.0933206Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:19:02.2078067Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:19:07.3387783Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:19:12.4529253Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:19:17.5664058Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:19:22.6833923Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:19:27.8291812Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:19:32.9445064Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:19:38.0645582Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:19:43.1869081Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:19:48.3017248Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:19:53.4021865Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:19:58.5040915Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:20:03.6107984Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:20:08.7195824Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:20:13.8342490Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:20:18.9765382Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:20:24.1071641Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:20:29.2446841Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:20:34.3575170Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:20:39.4749676Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:20:44.5974325Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:20:49.7189725Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:20:54.8412300Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:20:59.9541629Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:21:05.0777668Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:21:10.1818488Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:21:15.3035440Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:21:20.4147379Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:21:25.5358314Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:21:30.6587867Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:21:35.7717369Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:21:40.8985622Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:21:46.0219708Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:21:51.1524894Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:21:56.2634824Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:22:01.3800141Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:22:06.5203687Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:22:11.6355258Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:22:16.7557257Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:22:21.8659793Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:22:26.9811796Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:22:32.0958464Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:22:37.2160998Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:22:42.3389564Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:22:47.4715897Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:22:52.5881966Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:22:57.7332100Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:23:02.8490442Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:23:07.9611317Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:23:13.0825724Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:23:18.1964766Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:23:23.3308203Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:23:28.4524557Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:23:33.5699903Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:23:38.6849316Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:23:43.8253480Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:23:48.9477646Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:23:54.1214875Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:23:59.2384210Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:24:04.3887554Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:24:09.5027580Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:24:14.6300665Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:24:19.7514425Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:24:24.8804626Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:24:29.9867184Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:24:35.0976916Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:24:40.2083144Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:24:45.3274259Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:24:50.4434044Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:24:55.5601618Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:25:00.7186888Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:25:05.8746364Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:25:10.9946645Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:25:16.1137849Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:25:21.2308613Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:25:26.3583335Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:25:31.4720064Z PAIRED: joiner pinned (AlreadyTrusted)
2026-06-06T06:26:11.4608155Z PUMP_PEER_FAIL:bcead52b862344aef51998ca5d8f15dce1e38e6cee3795b219a5849f6ad4b41a:stream ended before Done
2026-06-06T06:26:46.1304445Z 
2026-06-06T06:26:46.1305811Z thread 'two_host_ladder_role_b' (2157729) panicked at crates/spt-daemon/tests/twohost.rs:247:5:
2026-06-06T06:26:46.1306947Z never converged on the rig: register: A's perch row replicated to B
2026-06-06T06:26:46.1308037Z note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
2026-06-06T06:26:46.1333876Z test two_host_ladder_role_b ... FAILED
2026-06-06T06:26:46.1334285Z 
2026-06-06T06:26:46.1334482Z failures:
2026-06-06T06:26:46.1334659Z 
2026-06-06T06:26:46.1334809Z failures:
2026-06-06T06:26:46.1342177Z     two_host_ladder_role_b
2026-06-06T06:26:46.1342627Z 
2026-06-06T06:26:46.1343092Z test result: FAILED. 1 passed; 1 failed; 0 ignored; 0 measured; 0 filtered out; finished in 900.54s
2026-06-06T06:26:46.1343684Z 
2026-06-06T06:26:46.1376375Z error: test failed, to rerun pass `-p spt-daemon --test twohost`
2026-06-06T06:26:46.1492371Z ##[error]Process completed with exit code 101.
